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(54) Video data encoding and recording 

(57) In an encoding apparatus having a memory of 
diminished size for lowering the production cost, the 
memory stores input video signals made up of plural pic- 
tures including intra-pictures (1-pictures) and a scene 
change detector 101 detects change points of the input 
video signals. An encoding unit 106 encodes pictures 
stored in the memory 102 by fixed length encoding tor 
generating a bitstream. A timing control unit 105 deter- 
mines successive groups of pictures, each including at 
least an intra-piclure, on the basis of the detection by 
the scene change detector 101, and controls the 
processing timing of fixed length encoding of each pic- 
ture in the group of pictures by the encoding unit 106. A 
rate control unit 107 sets a range from a picture next to 
an intra -picture to the next intra -picture as a range of 
the code generation rate in the encoding unit 106. The 
rate control unit 107 controls the range of the code gen- 
eration rate so that, if a scene change has been detect- 
ed, the amount of .the encoding information previously 
allocated to the intra-piclure will be allocated to other 
pictures. 
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Description 

This invention relates to data encoding and/or re- 
cording. 

A high-efficiency encoding system is known as the 
Motion Picture Image coding Experts Group (MPEG) 
system. With the MPEG system, inter-picture prediction 
is perlormed for curtailing redundancy along the time ax- 
is. To this end, the MPEG system provides for three pic- 
ture types, namely an Intra-picture or l-picture, a predic- 
tive coded picture or P-picture and a bidirectionally cod- 
ed picture or B-picture. The l-picture is an intra-coded 
picture, that is a picture encoded within a Irame itself, 
while the P-picture is a picture encoded by forward pre- 
diction and the B-picture is a picture encoded by bi-di- 
rectional prediction. 

The MPEG system also uses a group-ol-pictures or 
GOP structure for enabling random accessing. That is, 
random accessing can be carried out with a set of plural 
pictures as a unit. 

As shown in Fig. 1 , with picture data encoded in ac- 
cordance with the MPEG system, those beginning from 
an l-picture l(3) and ending at a picture prior to the next 
l-picture I (12) in the encoding sequence are grouped 
as one GOP. The reason is that, with the pictures 
grouped in this manner, picture reproduction may be re- 
alized when performing variable speed reproduction by 
decoding the l-picture which does not exploit inter-frame 
correlation, and the l-picture may be easily isolated by 
detecting the GOP header specilying the GOP entry 
point provided in each GOP. 

Although the size and the construction ol one GOP 
may be selected freely, the usual practice is to keep the 
size of one GOP constant at all times and to fix the 
number and construction of l-pictures, P-pictures and 
B-pictures in one GOP. 

However, with the fixed construction of one GOP, if 
a picture where a scene change has occurred is a P- 
picture or a B-picture, the picture cannot be coded 
smoothly, and the picture quality of the GOP containing 
such picture is deteriorated. 

Thus, with a proposed compression encoding ap- 
paratus employing the above-mentioned MPEG sys- 
tem, as shown in Fig. 2, the following processing is per- 
formed. 

First, input video signals are supplied to a scene 
change detection circuit 501 for detecting scene chang- 
es in the input video signals. Simultaneously, the input 
video signals are stored in a frame memory 502. In the 
proposed apparatus, the number of pictures in each 
GOP is set to 9 pictures for usual operations. Thus the 
frame memory 502 has a storage capacity of two GOPs, 
that is 18 pictures. At a point in time when 18 pictures 
of the input video signals are stored in the frame memory 
502, any scene change that occurred in the 18 pictures 
is detected by the scene change detection circuit 501. 
Belore the pictures held in the frame memory 502 are 
supplied to an encoding circuit 506, a timing control cir- 



cuit 505 determines the construction ol one GOP based 
on the detection output of the scene change detection 
circuit 501. 

It is now assumed that the state in which a picture 

s sequence from a B-picture B(1 ) to a P-picture P(18) are 
stored in the memory 502 is termed buffer status 1 , the 
state in which a picture sequence from a B-picture B(1 0) 
to an l-picture l(27) are stored in the memory 502 is 
termed a buffer status 2, and the state in which a picture 

io sequence from a B-picture B(19) to a P-picture P(36) 
are stored in the memory 502 is termed a buffer status 
3, as shown in Fig. 3. These states are such that, with 
the fixed construction of one GOP, the boundary be- 
tween one GOP and the next GOP is a GOP point, and 

75 18 pictures from one GOP point to the second GOP 
point are stored in the frame memory 502. If, with buffer 
status 1, a scene change is detected by the scene 
change detection circuit 501 at the 15th picture, that is, 
at the l-picture 1(15) on Fig. 3, the timing control circuit 

20 505 sets one GOP as being comprised of the first picture 
B(1) to the twelfth picture 1(12) in the display or picture 
sequence. If, with buffer status 2, a scene change is de- 
tected by the scene change detection circuit 501 at the 
25th picture, that is at the B-picture B(25), the timing 

2S control circuit 505 sets one GOP as being comprised of 
the 13th picture B(13) to the 24th picture P(24) in the 
display sequence, if, with buffer status 3, a new scene 
change has not been detected by the scene change cir- 
cuit 501, the timing control circuit 501 sets one GOP as 

30 being comprised of pictures from the previous scene 
change point up to the next GOP point, that is, as being 
comprised of the 25th picture B(25) up to the 27th pic- 
ture l(24) in the display sequence. 

As described above, the timing control circuit 505 

35 sets the size and construction of one GOP variably with- 
in a range of 2 GOPs, and routes the corresponding tim- 
ing control signals, such as those containing processing 
mode flags as later explained and picture type informa- 
tion, to a motion vector detection or motion estimator 

40 (ME) circuit 503, an encoding circuit 506 and a rate con- 
trol circuit 507. 

The ME circuit 503, encoding processing circuit 506 
and rate control circuit 507 perform processing opera- 
tions based on a timing control signal from the timing 

45 control circuit 505. 

The bit rate controlling operation of the circuit 507 
will now be explained with reference to the flow chart of 
Fig. 4. In general, the bit rate control circuit 507 includes 
a suitably programmed micro-computer (not shown). 

so When such micro-computer is started, parameters are 
first initialized at step S17 1 to enter an interrupt awaiting 
state (step S17 2 ). If an interrupt is applied, the above- 
mentioned processing mode flag and the picture type 
information are seized at steps S17 3 , S17 4 in order to 

55 judge the nature of the interrupt. In response to this 
processing mode flag, a decision is given at step S17 5 , 
step S17 6 and step S17 7 whether the interrupt is GOP- 
based, picture-based or macro-block-based, respec- 
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tively. Based on the results of such decision, the GOP- 
based processing (step S17 8 ), picture-based process- 
ing (step S17 10 ) or the macro-block-based processing 
(step S17-1-,) is performed. 

If, at step S17 6 , the interrupt is judged to be the 
GOP-based interrupt, the numbers of the I-, P- and B- 
pictures of the GOP currently processed, that is, the cur- 
rent GOP, are seized at step S17 8v and the amount of 
residual bits or the amount of the encoding information 
remaining which is allocated to the current GOP is cal- 
culated at step S1 7 82 . A transmission buffer (not shown) 
is initialized from one picture type to another in step 
S17 83 . 

With the above-described previously proposed 
compression encoding apparatus 100, since the size 
and the construction of one GOP are changed within a 
range of 2 GOPs in response to the results of scene 
change detection, the required capacity of the frame 
memory 502 is 2 GOPs, that is 18 pictures. Because ol 
the extremely large capacity of the frame memory 502, 
the production cost is prohibitively increased. 

In addition, since bit rate control for the encoding 
circuit 506 is performed by the timing control signal from 
the timing control signal 505 based on a GOP, as deter- 
mined by the timing control circuit 505, the total bit rate 
needs to be calculated each time the size of the GOP 
determined by the timing control circuit 505 is changed. 
In other words, since the amount ol the residual bits from 
those allocated to the current GOP needs to be calcu- 
lated each time the size of one GOP is changed, as 
shown in Fig. 4, the bit rate control operation becomes 
complex. 

On the other hand, if the bitstream obtained by the 
previously proposed compression encoding apparatus 
is recorded on a recording medium, the bitstream is 
lacking in the point information specifying a range of 
constant code generating bits, so that it has not been 
possible to do accurate writing or re-writing for a pre-set 
range of the recording medium by a re-writing system 
configured for doing overwriting on the recording medi- 
um. 

Various respective aspects of the present invention 
are defined in the appended claims. 

Embodiments of the present invention can provide 
a compression encoding apparatus and an apparatus 
for recording compression-encoded data and by which 
production costs may be lowered by significantly reduc- 
ing the size or capacity of the required memory. 

Embodiments of the present invention can provide 
a compression encoding apparatus and an apparatus 
for recording compression -encoded data and by which 
the encoding operation for the compression is simpli- 
fied. 

Embodiments of the present invention can provide 
a compression encoding apparatus by which compres- 
sion encoded data can be correctly written and re-writ- 
ten in a pre-set range at a pre-set position on a recording 
medium. 



Embodiments of the present invention can provide 
a recording apparatus for encoded data by which en- 
coded data can be correctly written and re-written in a 
pre-set range at a pre-set position on a recording medi- 
5 um. 

In accordance with one embodiment of the present 
invention, an encoding apparatus for encoding video 
signals made up of a plurality of pictures in accordance 
with an encoding system exploiting inter-frame predic- 

70 tion includes storage means for storing input video sig- 
nals, change point detection means for detecting 
change points of the pictures of the input video signals, 
encoding means for encoding the pictures stored in the 
storage means with a fixed encoding length as an en- 

75 coding unit for generating a bitstream, timing control 
means for determining a group of pictures inclusive of 
at least an intra-picture based on the results of detection 
of the change point detection means and for controlling 
the processing timing of the fixed length encoding of 

20 each picture in the group of pictures by the encoding 
means, and rate control means for controlling the range 

°fJJ?§_ coc l? „9 e j?. e . r . a . t .!°. r l rate in ! ne encoding means 
based on the results of detection by the change point 
detection means under control of the timing control 

25 means.. In the foregoing : the rate control means sets a 
range for the code generation rate which ranges from a 
picture next to an intra-picture to the next intra-picture. 
If a scene change has occurred, the residual of the 
amount of the encoding information previously allocated 

30 \o the intra-picture is allocated to another picture. If a 
change point, such as a scene change, is detected in 
the intra-picture, the picture where the change point has 
occurred is switched to an intra-picture to do fixed- 
length coding, so that data recorded on the recording 

35 medium may be reproduced without deterioration in pic- 
ture quality, and hence an optimum reproduced picture 
is obtained. Since it is only necessary for the storage 
means to have a storage capacity of at least three pic- 
tures, the memory size may be reduced significantly as 

40 compared to that with the previously proposed appara- 
tus, thus lowering the production cost of the apparatus. 

In accordance with another embodiment of the 
present invention, an apparatus for encoding video sig- 
nals made up of a plurality of pictures in accordance with 

45 an encoding system exploiting inter-frame prediction 
and for recording the encoded data in a recording me- 
dium includes storage means for storing input video sig- 
nals, change point detection means for detecting 
change points of the pictures of the input video signals, 

50 encoding means for encoding the pictures stored in the 
storage means in a fixed length as an encoding unit for 
generating a bitstream, timing control means for deter- 
mining a group of pictures inclusive of at least an intra- 
picture based on the results of detection of the change 

55 point detection means and for controlling the processing 
timing of the fixed length encoding of each picture in the 
group of pictures by the encoding means, rate control 
means for controlling the range of the code generation 
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rate in the encoding means based on the results of de- 
tection by the change point detection means under con- 
trol ot the timing control means, and recording means 
tor recording a bitstream obtained by the encoding 
means on a recording medium. The rate control means 
sets a range of from a picture next to an intra-picture to 
the next intra-picture as a range of code generation rate. 
If a scene change has occurred, the residual of the 
amount of the encoding information previously allocated 
to the intra-picture is allocated to another picture. If a 
change point, such as a scene change, is detected in 
the intra-picture, the picture where the change point has 
occurred is switched to an intra-picture to do fixed- 
length coding, so that data recorded on the recording 
medium may be reproduced without deterioration in pic- 
ture quality, and hence an optimum reproduced picture 
is obtained. Since it is only necessary for the storage 
means to have a storage capacity of at least three pic- 
tures, the memory size may be reduced significantly as 
compared to that with the conventional recording appa- 
ratus, thus lowering the production cost of the appara- 
tus. 

With the encoding apparatus, the rate control 
means preferably fixes the number of pictures in a range 
of a code generation rate and a start picture. This ena- 
bles correct fixed length encoding. For recording on a 
recording medium the encoded data obtained with the 
encoding apparatus, the encoded data can be reliably 
written or re-written in a pre-set range of the recording 
medium. Since the range of the encoding generation 
rate is fixed, it is unnecessary to calculate the desired 
encoding length, thus simplifying the encoding process. 

With the encoding apparatus, the rate control unit 
preferably doubles the code generation rate on detec- 
tion of a scene change. If a change point, such as a 
scene change, occurs in input video signals, the amount 
of the encoding information previously allocated to the 
intra-picture may be reliably allocated to another pic- 
ture. 

With the encoding apparatus, the encoding means 
preferably inserts the information specifying the range 
of the code generation rate into the bitstream under con- 
trol of the rate control means. In this manner, when re- 
cording the encoded data obtained with the encoding 
apparatus, the encoded data can be written and re-writ- 
ten more reliably in a pre-set range of the recording me- 
dium. 

With the encoding apparatus, the result of detection 
by the change point detection means is preferably over- 
ridden until the other picture is fixed-length encoded by 
the encoding means. In this manner, fixed length encod- 
ing may be maintained within the range of the code gen- 
eration rate even if a scene change has occurred. 

With the encoding apparatus, the change point de- 
tection means preferably detects a change point of the 
input video signals by the residual information found at 
the time of motion vector detection in the inter-frame 
prediction. This enables correct detection of a change 
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point in the input video signals. 

The invention will now be described by way of ex- 
ample with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
s ences, and in which: 



Fig. 1 illustrates a range for one GOP and bit rate 
control in accordance with a previously proposed 
system; 

Fig. 2 is a block diagram showing the construction 
of a previously proposed encoding apparatus; 
Fig. 3 illustrates picture type management in a case 
in which a scene change has occurred in the encod- 
ing apparatus of Fig. 2; 

Fig. 4 is a flowchart showing bit control in the en- 
coding apparatus of Fig. 2; 

Fig. 5 is a block diagram showing the construction 
of a compression encoding apparatus according to 
an embodiment of the present invention; 
Fig. 6 illustrates the configuration for one GOP and 
bit rate control with the previously proposed encod- 
ing apparatus as contrasted with that according to 
the present embodiment; 

Fig. 7 illustrates picture type management for scene 
change occurrences in the encoding apparatus of 
Fig. 5; 

Fig. 8 is a flowchart to which reference is made in 
explaining bit rate control with the apparatus of Fig. 

5; 

Fig. 9 illustrates picture type management in case 
the bit rate control is enhanced by a factor of two; 
Fig. 10 is a flowchart to which reference will be 
made in explaining bit rate control in case the bit 
rate control is enhanced by a factor of two; 
Fig. 11 is a block diagram showing the construction 
of an encoding apparatus according to a modified 
embodiment of the present invention; 
Fig. 1 2 is a block diagram showing the construction 
ol a recording apparatus for encoded data accord- 
ing to an embodiment of the present invention; 
Fig. 13 illustrates picture type management for 
scene change occurrences in the encoding circuit 
of the recording apparatus shown in Fig. 12; 
Fig. 14 illustrates a fixed length unit of a disc- 
shaped recording medium that may be used with 
the recording apparatus of Fig. 12; 
Fig. 15 illustrates a bitstream format of the MPEG2 
system; 

Fig. 16 illustrates a case in which at least one or 
more bit rate control units are combined in recording 
the bitstream on the recording medium; and 
Fig. 17 illustrates a case in which the normal posi- 
tion for the l-picture comes first in bit rate control in 
recording a bitstream on the recording medium. 
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An encoding apparatus 1 00 according to an embod- 
iment of the present invention is shown in Fig. 5 to in- 
clude a scene change detection circuit 101 and a frame 
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memory 102, both ted with input video signals through 
an input terminal 1. The encoding apparatus 100 also 
includes a counter 104 and a timing control circuit 105 
fed with outputs ol the counter 104 and the scene 
change detection circuit 101. The encoding apparatus $ 
. .1 00 further includes a motion vector detection or motion 
estimator (ME) circuit 103 fed with outputs of the frame 
memory 102 and the timing control circuit 105, and a 
rate control circuit 107 fed with an output of the timing 
control circuit 105. In the encoding apparatus 100, an to 
encoding processing circuit 106 is fed with outputs of 
the frame memory 102, ME circuit 103, timing control 
circuit 105 and rate control circuit 107, and a variable 
length encoding (VLC) circuit 109 is fed with outputs of 
the timing control circuit 1 05 and the encoding process- *5 
ing circuit 106. Moreover, in the encoding apparatus 
100, an output control circuit 112 is fed with an output 
of the VLC circuit 109, and a code buffer 110 is fed with 
outputs of the VLC circuit 1 09 and the output control cir- 
cuit 112. The encoding apparatus 100 additionally in- 20 
eludes an output interfacing (l/F) circuit 1 1 1 fed with out- 
puts of the output control circuit 1 1 2 and the code buffer 
110, and a buffer counter 108 fed with outputs of the 
VLC circuit 109 and the output l/F circuit 111 . 

The output of the timing control circuit 105 is also 25 
fed to the frame memory 102, and the code buffer 110 
also receives outputs of the output l/F circuit 111 and 
the VLC circuit 109, while the rate control circuit 107 is 
fed with an output of the code buffer 110. 

The above-described encoding apparatus 100 ex- 30 
ploits the MPEG system, and handles picture data com- 
prised of intra-lrame coded pictures (l-pictures) : forward 
predictive coded pictures (P-pictures) and bi-directional 
predictive coded pictures or B-pictures. The original pic- 
ture data enter the encoding apparatus 100 shown in 35 
Fig. 5 as video signals in the picture sequence of B(1), 
B(2), l(3) ,B(4), B(5),P(6), . . ., as shown in Fig. 6. Thus, 
if the number of pictures making up a GOP of the input 
video signals is set to 9, the GOP is comprised of B(1) 
to P(9). In encoding the pictures, entered in the forego- 40 
ing picture sequence, encoding is performed on respec- 
tive pictures interchanged in their positions in terms of 
a GOP as a unit in accordance with the rule of the GOP 
structure. In other words, as shown in Fig. 6, encoding 
is. performed in an encoding sequence of l(3), B(1), B 
(2), P(6), B(4), B(5) which is different from the pic- 
ture sequence. 

A series of operations performed in the encoding 
apparatus 100 will now be explained. 

The video signals supplied to the encoding appara- $0 
tus 100 are fed to the scene change detection circuit 
1 01 and to the frame memory 1 02. 

Since the original picture data handled by the en- 
coding apparatus 100 has two B-pictures between the 
l-picture and the P-picture, as shown in Fig. 6, the frame ss 
memory 102 has a storage capacity of three pictures. 
Consequently, the input video signals are stored in the 
frame memory 102 with three pictures being taken as 



the units thereof. 

The scene change detection circuit 101 detects any 
picture in the input video signals where a scene change 
has occurred, and supplies the results of such detection 
to the timing control circuit 105. 

The counter .104 is shown on Fig. 5 to be made up 
of a picture counter 104a, a macro-block counter 104b 
and a counter 104c for performing various other count- 
ing operations. The counter 104 detects horizontal syn- 
chronization signals and vertical synchronization sig- 
nals in the input video signal and counts the clocks in a 
macro-block, the number of macro-blocks in the picture 
and the number of pictures in the GOP in a timed relation 
to these synchronization signals. The count values of 
the counter 1 04 are supplied to the timing control circuit 
105. 

The timing control circuit 105 is shown on Fig. 5 to 
include a GOP flag generator 105a, a picture flag gen- 
erator 105b, a macro-block generator 105c, a point flag 
generator 105d for setting a fixed length and a timing 
generator 1 05e for generating a variety of timing signals. 
The timing control circuit 105 sets the positions of I-, P- 
and B-pictures and the GOP points based on various 
count values from the counter 104 and on the results of 
detection by the scene change detection circuit 101. 
Thus, the timing control circuit 105 generates timing 
control signals for the positions of the J-, P- and B-pic- 
tures and the GOP points, as well as processing mode 
flags as later explained and the picture type information, 
by the above generators 105a to 105e, and transmits 
the generated data to the frame memory 102, ME circuit 
103, encoding circuit 106, VLC circuit 109 and rate con- 
trol circuit 107. The processing for determining the po- 
sitions of the P- and B-pictures and the GOP points 
by the timing control circuit 105 will be subsequently ex- 
plained in detail. 

The pictures stored in the frame memory 102 are 
read out by the timing control signal supplied to the latter 
from the timing control circuit 105 in a coding sequence 
in which the pictures in a GOP are arrayed differently 
from the original picture sequence. The pictures read 
out from the frame memory 102 are supplied to the ME 
circuit 103 and to the encoding processing circuit 106. 

The ME circuit 103 causes read out of a previous 
picture stored in a frame memory 106g of the encoding 
processing circuit 106 as later explained, as a search 
frame, based on the timing control signal from the timing 
control circuit 105, and detects, on the basis of a motion 
vector, which block in that previous picture is matched 
by each block of a picture from the Irame memory 102. 
The ME circuit 1 03 routes the detected motion vector to 
the encoding processing circuit 106. 

The encoding processing circuit 106 further in- 
cludes a subtraction circuit 106a fed, at one input, with 
pictures from the frame memory 1 02, and an orthogonal 
transform circuit 106b which, in the illustrated encoding 
apparatus 100, is a discrete cosine transform (DCT) cir- 
cuit. The encoding processing circuit 106 also includes 
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a quantization circuit 106c led with an output ot the DCT 
circuit 1 06b, and an inverse quantization circuit 1 06d ted 
with an output ot the quantization circuit 106c. Further, 
in the encoding processing circuit 106, an inverse DCT 
circuit 106e is ted with an output ol the inverse quanti- 
zation circuit 1 06d : and an addition circuit 1 06! receives, 
at one ot its inputs, an output ot the inverse DCT circuit 
106e. The frame memory 106g is ted with an output of 
the addition circuit 1 06f and a motion compensation pre- 
diction or motion compensator (MC) circuit 106h re- 
ceives the output of frame memory 106g. The output of 
the motion compensator circuit 106h is supplied to a 
second input of the subtraction circuit 106a and also to 
a second input of the addition circuit 106f. 

An output of the ME circuit 103, that is, the above- 
mentioned motion vector information, is supplied to the 
frame memory 106g, while an output of the rate control 
circuit 107 is fed to both the quantization circuit 106c 
and the inverse quantization circuit 106d s and an output 
of the quantization circuit 106c is ted to the VLC circuit 
109. 

Each processing by the encoding processing circuit 
106 which will now be explained is controlled on the ba- 
sis of timing control signals from the timing control circuit 
105. 

Using motion vector information stored in the frame 
memory 106g, the MC circuit 106h reads out the previ- 
ous picture stored inthetrame memory 106gto perform 
motion compensation thereon. The MC circuit I06h 
routes the motion-compensated previous picture to the 
subtraction circuit 106a, while storing the picture in the 
frame memory 106g. 

The subtraction circuit 106a finds the difference be- 
tween the picture Irom the frame memory 102 and the 
previous picture motion -compensated by the MC circuit 
I06h, and routes the resulting difference data to the 
DCT circuit 106b. 

The DCT circuit 106b performs two-dimensional 
DCT on the difference data from the subtraction circuit 
106a and routes the resulting DCT coefficients to the 
quantization circuit 106c. 

The quantization circuit 106c quantizes the DCT co- 
efficients from the DCT circuit 106b at an arbitrary quan- 
tization step Q, under control of the rate control circuit 
107, and routes the resulting quantized DCT coefficients 
to both the VLC circuit 109 and the inverse quantization 
circuit 106d. 

The inverse quantization circuit I06d inverse quan- 
tizes the quantized data from the quantization circuit 
106c at the quantization step Q employed by the quan- 
tization circuit 106c, under control of the rate control cir- 
cuit 107, for restoring the DCT coefficients, which are 
then supplied to the inverse DCT circuit 106e. 

The inverse DCT circuit 1 06e performs inverse DCT 
on the DCT coefficients from the inverse quantization 
circuit 106d for restoring the DCT coefficients from the 
inverse quantization circuit 106d to data on the spatial 
axis, that is, to the difference data obtained by the sub- 



traction circuit 106a, and routes the resulting difference 
data to the addition circuit 106f. The addition circuit 106f 
adds the motion-compensated previous picture ob- 
tained from the MC circuit 106h to the difference data 
5 from the inverse DCT circuit 106e for restoring the cur- 
rent picture which is then stored, as a previous picture, 
in the frame memory 106g. 

The data thus reduced in redundancy in both the 
time axis and the frequency axis by the ME circuit 103 
to and the encoding processing circuit 106 are outputted 
from the encoding processing circuit 106 to the VLC cir- 
cuit 109. The VLC circuit 109 allocates variable length 
codes to the data from the encoding processing circuit 
106, on the basis of the respective timing control signal 
is from the timing control circuit 105, and stores the gen- 
erated bitstream in the code buffer 110. 

The code buffer 110 outputs the bitstream from the 
VLC circuit 109 via the output interfacing circuit 111 un- 
der the control of the output control circuit 112. 
20 At this time, the buffer counter 108 counts the 
number of times data is written in the code buffer 110 
by the VLC circuit 109 for detecting the number of bits 
of the actually generated encoded data. The buffer 
counter 108 also counts the number of times data is read 
25 from the code buffer 110 to the output interfacing circuit 
111 for detecting the take-up or storage ratio of the code 
buffer 110. The buffer counter 108 routes the detected 
bit number information and the detected buffer storage 
ratio information to the rate control circuit 107. 
30 The rate control circuit 107 controls the quantization 
circuit 106c and the inverse quantization circuit 106d of 
the encoding processing circuit 106, on the basis of the 
detected bit number information and the buffer storage 
ratio information from the buffer counter 1 08, so that the 
35 amount of the generated data will be maintained lower 
than the number of bits of the desired fixed length and 
so that overflow from the code buffer 110 is avoided. 

The processing by the timing control circuit 105 and 
the output control circuit 112 for determining the posi- 
40 tions of the I-, P- and B-pictures and the GOP point will 
now be explained. 

Initially, it should be noted that, with the encoding 
apparatus of Fig. 3, the range of bit rate control in the 
transmission of a bitstream obtained by encoding is the 
45 same as the GOP range, and the number of residual bits 
is set as the scheduled number of bits for a GOP under 
consideration. The number of the residual bits is con- 
trolled to be decreased each time a picture of the GOP 
is encoded such that it becomes zero after encoding the 
50 last picture in the GOP 

Conversely, with the encoding apparatus 100, the 
range of bit rate control differs from the GOP range, as 
shown in Fig. 6, such that for the GOP range of, for 
example, from I (3) to B(8) in the encoding sequence, 
55 the range of bit rate control is from the B-picture B(1) 
which is next to the l-picture t(3) to the l-picture 1(12) of 
the next GOP. By performing bit rate control on the I- 
picture 1(12), a large number of residual bits are left at 
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a trailing end of a GOP The encoding apparatus 100 
exploits the fact that bits are left at the trailing end of the 
GOP 

More specifically, if video signals are supplied to the 
encoding apparatus in the picture sequence of B(1), B s 

(2), l(3), B(4), B(5), P(6) as shown in Fig.7, the first 

three pictures, namely B(1), B(2) and 1(3), are first 
stored in the frame memory 102. This is termed buffer 
status 1. 

The timing control circuit 105 then generates and to 
transmits timing control signals which will cause the last 
entered picture 1(3) to be read out first from the frame 
memory 102 to the encoding processing circuit 106 and 
to the ME circuit 103. The timing control circuit 105 then 
generates andtransmits timing control signals which will *5 
cause the pictures B(1) and B(2) to be read out in this 
sequence from the frame memory 102 to the encoding 
processing circuit 106 and to the ME circuit 103. 

In this manner, the pictures 1(3), B(1) and B(2) are 
supplied in the stated sequence to the encoding 20 
processing circuit 106, and the above-mentioned en- 
coding operation is performed on the sequentially sup- 
plied pictures in a manner as described above. 

The timing control signals generated by the timing 
control circuit 105 are also supplied to the rate control 25 
circuit 107. The rate control circuit 107 is reset by the 
timing control signal from the timing control circuit 105 
at a time point when the picture B(1) next following the 
picture l(3) is supplied to the encoding processing circuit 
106. 30 

Then, three pictures B(4), B(5) and P(6) are stored 
in the frame memory 1 02. This is termed buffer status 2. 

In this case, the timing control circuit 1 05 generates 
and transmits timing control signals which will cause the 
above pictures to be read out from the frame memory 35 
102 to the encoding processing circuit 106 and to the 
ME circuit 103 in the sequence of P(6), B(4) and B(5). 
The encoding processing circuit 106 again encodes the 
pictures sequentially supplied thereto from the frame 
memory 102. 40 

Then, three pictures B(7), B(8) and P(9) are stored 
in the frame memory 102. This is termed buffer status 3. 

In this case, the timing controlling circuit 105 gen- 
erates and transmits timing control signals which will 
cause the above pictures to be read out from the Irame *5 
memory 102 to the encoding processing circuit 106 and 
to the ME circuit 103 in the sequence of P(9), B(6) and 
B(8). The encoding processing circuit 106 once again 
encodes the pictures sequentially supplied thereto from 
the frame memory 102. so 

With the encoding apparatus 100, since nine pic- 
tures of the input video signals are grouped together as 
one GOP, the timing control circuit 105 detects a GOP 
point after, entry of the ninth picture P(9) based on the 
count value of the picture counter 104a in the counter ss 
1 04. Since no scene change is produced in buffer status 
1 , 2 or 3, the timing control circuit 105 sets the range of 
one GOP from 1(3) to B(8) in the encoding sequence, 



and routes a GOP flag specifying the GOP point from 
the GOP flag generator 105a to the VLC circuit 109 and 
to the rate controlling circuit 107. At this time, a large 
number of bits, among the bits allocated to the GOP, are 
left in the last picture B(8) of the GOP 

Then, three pictures B(10), B(11) and 1(12) are 
stored in the frame memory 102. This status is termed 
buffer status 4. 

In this case, the timing control circuit 105 generates 
and transmits timing control signals which will cause the 
above pictures to be read out from the frame memory 
102 to the encoding processing circuit 106 and to the 
ME circuit 103 in the sequence of 1(12), B(10) and B(11), 
and further cause the read out pictures to be encoded 
by the encoding processing circuit 106. 

The timing control circuit 105 has already set the 
pictures 1(3) to B(8) as one GOP in the encoding se- 
quence. Before the picture B(10) next following the last 
picture of the GOP thus set, that is the B-picture B(10) 
next to the picture 1(12) in Fig. 7, is supplied to the en- 
coding processing circuit 106, the fixed length setting 
point flag generator 1 05d of the timing control circuit 1 05 
routes a flag specifying a fixed length setting point to 
both the rate controlling circuit 107 and the VLC circuit 
109. 

The rate control circuit 1 07 detects the flag from the 
fixed length setting point flag generator 105d and, in re- 
sponse to such detection, the rate control circuit 107 re- 
sets the number of residual bits for the current GOP and 
sets the amount or number of residual bits allocated to 
the next GOP 

The VLC circuit 109 detects the flag from the fixed 
length setting point flag generator 105d and inserts this 
flag as a fixed length point flag in a picture header of the 
first picture within the range of the executed bit rate con- 
trol, that is, within the picture header of the picture B(1 0), 
as will now be described in detail. 

In a bitstream of the MPEG2 system, for example, 
as shown in Fig. 15 and hereafter described in further 
detail, a sequence expanding portion is provided directly 
after the sequence header. This sequence expanding 
portion is used as an index for discriminating the MPG2 
system, in which such sequence expanding portion ex- 
ists, from the MPEG 1 system in which no sequence ex- 
panding portion exists. The sequence expanding por- 
tion describes various tools provided in the MPEG2. By 
means of such sequence expanding portion and a func- 
tion expanding portion, the bitstream of the MPEG2 sys- 
tem can realize a large number of additional functions 
while maintaining interchangeably with the MPEG1 
system. 

If the MPEG2 system is used for the encoding ap- 
paratus 100 embodying this invention, '11 11 11 11 
(BYTE)" is inserted as the fixed length point flag in one 
byte (= 8 bit) area in the expansion portion following the 
picture encoding function expanding portion and in the 
user data in the user data portion, as a way of inserting 
the above-mentioned fixed length point flag in the pic- 



7 



13 



EP 0 762 778 A2 



14 



ture header. 

If the fixed length point flag is detected from the bit- 
stream outputted by the VLC circuit 1 09 5 the output con- 
trol circuit 112 controls the output interfacing circuit 111 
and the code buffer 110 for adding bits corresponding 
to a deficit portion of one fixed length between the fixed 
length point flag and the next fixed length point flag. 

The fixed length point flag is inserted in this manner 
in a picture header of the first picture of a scheduled bit 
rate control unit in response to the flag outputted by the 
fixed length setting point flag generator 105d. The bit 
rate control range or unit (A) is set so as to differ from 
the GOP range, that is, it is set to a range from one fixed 
length point flag to the next fixed length point flag, for 
example, from the picture l(3) to the picture 1(12) of the 
next GOP/Consequently, bit rate control is performed 
on the last l-picture 1(12) of the bit rate control range or 
unit with the large number of bits left on encoding the 
last picture B(8) of the GOP. 

Then, three pictures B(13), B(14) and 1(15) are 
stored in the frame memory 102. This status is termed 
butler status 5. 

If a scene change is detected at the 15th picture I 
(15), the timing control circuit 105 sets the pictures I(I2) 
to B(11) as one GOP in the encoding sequence. The 
timing control circuit 105 generates a timing control sig- 
nal by which the 15th picture, accompanying a time slot 
which should inherently be allocated to a P-picture, is 
processed as an i-picture. In other words, the timing 
control circuit 1 05 generates and transmits a timing con- 
trol signal which will cause the picture 1(15) to be initially 
read out Irom the frame memory 102 to the encoding 
processing circuit 106 and to the ME circuit 103. Con- 
sequently, the number of residual bits allocated to the 
GOP is significantly reduced at this picture 1(15). 

This sets the butler status 6 in which three pictures 
B(16), B(17) and P(18) are stored in the frame memory 
1 02. When buffer status 7 is reached in which three pic- 
tures B(19), B(20) and P(21) have been stored in the 
frame memory 102, the timing control circuit 105 pro- 
duces a timing control signal by which the 21st picture, 
occupying a time slot which should inherently be allo- 
cated to an l-picture, is processed as a P-picture. 

In other words, in buffer status 7, the timing control 
circuit 105 generates, and transmits to frame memory 
102, a timing control signal which will cause the picture 
P(21 ) to be read out last from the frame memory 1 02 to 
the encoding processing circuit 1 06 and to the ME circuit 
103. 

On the other hand, the fixed length point flag gen- 
erator 1 05d of the timing control circuit 1 05 routes a flag 
specifying a fixed length point to the rate control circuit 
107 and to the VLC circuit 109 at such a timing that the 
bit rate control range or unit (B) of the current GOP will 
be the same as the earlier bit rate control range or unit 

(A) irrespective of the scene change detection and the 
results thereof. Consequently, the bit rate control range 

(B) differs from the GOP range, such that bit rate control 



is executed at all times in a pre-set range. 

If buffer status 8, in which three pictures B(22), B 
(24) and P(24) are stored in the frame memory 102, and 
buffer status 9 in which three pictures B(25), B(26) and 
5 I (27) are stored in the frame memory 102, have been 
attained, while a scene change has been detected in the 
25th picture B(25), the timing control circuit 1 05 sets the 
pictures 1(15) to B(23) in the encoding sequence as one 
GOP, starting from the previously mentioned time of de- 
io tecting the scene change at the 1 5th picture. The timing 
control circuit 1 05 also generates a timing control signal 
by which the 25th picture, in a time slot which should 
inherently be allocated to a P-picture, will be processed 
as the l-picture i(27). 
is In buffer status 1 0, in which three pictures B(28), B 

(29) and P(30) are stored in the frame memory 102, tim- 
ing control circuit 105 generates a timing control signal 
by which the 28st picture, in a time slot which should 
inherently be allocated to an l-picture, will be processed 
20 as the P-picture P(30). 

On the other hand, the fixed length point flag gen- 
erator 105d routes a flag specifying a fixed length point 
to the rate control circuit 107 and to the VLC circuit 109 
at such a time that the bit rate control range or unit (C) 
25 of the current GOP will be the same as the bit rate control 
ranges (A) and (B) irrespective of the results of scene 
change detection. Consequently, the bit rate control 
range (C) differs from the GOP range, and bit rate con- 
trol is executed at all times in a pre-set range. 
30 The bit rate control sequence performed by the bit 
rate control circuit 107 will be explained in detail with 
reference to the flow chart of Fig. 8. 

In general, the rate control circuit 107 may be con- 
stituted by a suitably programmed micro-computer (not 
35 shown). When such micro-computer is started, param- 
eters are first initialized at step to enter an interrupt 
awaiting state at step S4 2 . If an interrupt is applied, the 
above-mentioned processing mode flag and the picture 
type information from the timing control circuit 105 are 
40 seized at steps S4 3 , and S4 4 in order to judge the nature 
of the interrupt. 

In the background art illustrated in Fig. 4, a judg- 
ment as to whether the interrupt is GOP-based, picture- 
based or macro-block-based is effected by detecting the 
45 GOP flag, picture flag or the macro-block flag 1rom the 
processing mode flag. However, with the encoding ap- 
paratus 100 embodying this invention, the fixed length 
flag is detected in place of the GOP flag specifying that 
the interrupt is GOP-based. If this fixed length flag is 
so detected, fixed length unit based processing is per- 
formed. 

More specifically, in Fig. 8, it is judged whether or 
not the fixed length flag has been detected from the 
processing mode flag at step S4 6 . If this fixed length flag 
55 is detected, the number of residual bits of the current 
GOP is reset in step S4 6 , and the code buffer 110 is 
reset from one picture type to another in step S4 7 prior 
to returning to step S4 2 in order to await an interrupt. In 
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other words, since the bit rate control range is constant 
with the encoding apparatus 100 : it is unnecessary to 
calculate the length intended to be fixed, and it is only 
necessary to reset the number of residual bits. 

If. the fixed length setting flag is not detected at step 5 
..S4 5 , the . program proceeds to. step S4 8 . in which it is 
judged from the processing mode flag whether or not 
the picture flag has been detected from the processing 
mode flag. 

If the picture flag has been detected in S4 8 , the to 
number of residual bits is updated at step S4 9 . The 
number of residual bits is found by subtracting the 
number of bits actually found in the previous picture from 
the number of residual bits prior to updating. The 
number of residual bits subsequent to updating, as thus is 
found, is used as the number of residual bits of the cur- 
rent picture. 

The degree of complexity is then found from the 
mean value of the quantization scale of the previous pic- 
ture and updated from one picture type to another in step 20 
S4 10 - 

The average activity, such as, a value of the spatial 

resolution of the previous picture, is then calculated in 
step 34^). 

The total number of bits of the current picture is then 2s 
calculated in step S4 12> and then the total number of bits 
is calculated from one macro-block to another in step 
S4 13 prior to returning to step S4 2 in order to await an 
interrupt. 

If no picture flag has been found at step S4 e , the 30 
program proceeds to step S4 14 where it is judged from 
the processing mode flag whether or not the macro- 
block has been detected. 

If the macro-block has been detected, the quantiza- 
tion scale is determined in step S4 16 on the basis of the 3S 
storage ratio of the code buffer 1 1 0 and on the basis of 
the ratio of the mean activity of the previous picture to 
the macro-block activity of the current picture. 

In the next step S4 16 , the code buffer 110 is updat- 
ed, using the number of the actually produced or gen- 40 
erated bits in the macro-block and the total number of 
bits intended to be included in a micro-block, and then 
the program is returned to step S4 2 in order to await an 
interrupt. 

If, with the above-described encoding apparatus 45 
100, the GOP range without scene change is set to ex- 
tend from an l-picture to the picture prior to the l-picture 
of the next GOP in the encoding sequence, a range ex- 
tending from a picture nexttothe l-picture to the l-picture 
of the next GOP is used as the range of bit rate control, so 
If a scene change has occurred, the bit rate control 
range is kept constant, and a picture inherently sched- 
uled to be processed as a P-picture, that is, a picture 
appearing as a P-picture in the original picture se- 
quence, is processed as an l-picture, and the number ss 
of residual bits which should be ultimately left is allocat- 
ed to a forward portion of the GOP If an l-picture is al- 
located first by a scene change as described above, the 



last picture in the bit rate control range is a P-picture. In 
addition, the range of one GOP is set in this case as the 
range from the first allocated l-picture to the next l-pic- 
ture. 

In this manner, fixed length setting may be reliably 
achieved .within a . range of executed bit rate control. In 
addition, since fixed length setting may be achieved re- 
liably, data writing and re-writing may be reliably per- 
formed in a pre-set range of a recording medium. In ad- 
dition, since it is only necessary for the frame memory 
102 to have a storage capacity of at least three pictures, 
the memory size can be significantly less than that with 
the previously proposed apparatus, thus further lower- 
ing the cost of the apparatus. 

An encoding apparatus which is a modification of 
the embodiment of the invention described with refer- 
ence to Figs. 5-8, will now be described with reference 
to Figs. 9 and 10 as having bit rate control operations 
different from those described above for the encoding 
apparatus 100, although the modified encoding appara- 
tus is structurally similar to the encoding apparatus 1 00. 
More particularly. Fig. 9 shows picture management in 
the modified encoding apparatus, while Fig: 10 shows, 
in a flowchart: the bit rate control processing employed 
in the modified apparatus. The GOP range in the ab- 
sence of scene changes and the bit rate control range 
for such case are the same as in the background art and 
hence are not explained in detail. 

In addition, with the exception of the routine or se- 
quence of steps indicated at S6 on Fig. 10, it is to be 
noted that the sequence of operations in the flowchart 
of Fig. 10 is the same as that in the flowchart for bit rate 
control shown in Fig. 8. Therefore, the steps indicating 
the same operations described above with reference to 
Fig. 8 are denoted by the same reference numerals, and 
are not further explained in detail herein. 

If, in buffer status 5 in which three pictures B(13), B 
(14) and 1(15) have been stored in the frame memory 
102, a scene change has been detected by the scene 
change detection circuit 1 01 at the 1(1 5) picture, the tim- 
ing control circuit 105 sets 1(12) B(10) and B(11) as one 
GOP in the encoding sequence, as in the earlier-de- 
scribed embodiment, and generates a timing control sig- 
nal at the next GOP by which the 1 5th picture, occupying 
a time slot which should inherently be allocated to a P- 
picture, will be processed as an l-picture l-(15). 

The number of bits forvthe l-picture, among the 
number of residual bits allocated by the rate control cir- 
cuit 107, is already used up at the time of encoding the 
l-picture 1(12). Therefore, in the embodiment being de- 
scribed with reference to Figs. 9 and 10, the bit rate con- 
trol range is increased by a factor of two. 

Referring now to Fig. 10, it will be seen that, in the 
bit rate control sequence of the modified encoding ap- 
paratus, after the picture type information has been 
seized in step S4 4; it is judged, in step S6-, , of subroutine 
S6, whether or not the GOP flag has been detected in 
place of judging, as in step S4 5 on Fig. 8 : whether or not 
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the fixed length setting flag has been detected from the 
processing mode flag. 

II the GOP flag is detected, it is then judged whether 
or not a scene change has been detected in step S6 2 . 

II a scene change has been detected, it is assumed 
that GOP-based processing has to be performed due to 
occurrence of such scene change. Thus the number of 
remaining bits of the current GOP has to be checked at 
step S6 3 in order to effect bit rate control in terms of two 
GOPs, that is 18 pictures, as a unit. The code or trans- 
mission buffer 110 is initialized from one picture type to 
another in the next step S6 4 and, in order to prohibit in- 
terrupts in connection with the GOP-based processing 
at the next inherent GOP point, the code buffer 110 
turns-on an internal flag in step S6 5 for indicating the 2 
GOP-based processing and returns the program to step 
S4 2 for awaiting an interrupt. 

If no scene change has been detected in step S6 2 , 
that is, if the processing is the usual GOP-based 
processing, it is checked in step S6 6 whether or not the 
internal flag specifying the 2-GOP-based processing 
has been turned on. 

il the internal flag specifying the 2-GOP based 
processing has been turned on, the internal flag is 
turned off in step S6 7 in order to return to the interrupt 
awaiting state in step S4 2 . 

In the modified embodiment being here described, 
the number of residual bits, scheduled to be used in the 
next GOP, is used in the current GOP as in step S6 e , 
while the l-picture, scheduled to be allocated to the next 
GOP, is processed as a P-picture as in step S6 9 . If the 
mode of doing bit rate control in terms of two GOPs as 
a unit is entered, a flag indicating such processing mode 
is turned on. If, with such flag on, a new scene change 
has occurred; this scene change is overridden. This as- 
sures that, if a scene change has occurred, fixed length 
is maintained within the range of two GOPs, thus assur- 
ing reliable fixed length setting within the bit rate control 
range and allowing for more flexibility in coping with 
scene changes. Since fixed length setting can be relia- 
bly achieved, writing and re-writing in a pre-sel range 
on a recording medium can be reliably effected. Since 
it is only necessary for the frame memory 102 to have 
a storage capacity for at least three pictures, the mem- 
ory size can be significantly reduced as compared to 
that required in the previously proposed apparatus, thus 
lowering the production cost of the apparatus. 

An encoding apparatus 200 according to another 
embodiment of the invention is shown in Fig. 11 to com- 
prise a new frame memory 201 and a memory 202 in 
addition to the components of the encoding apparatus 
100 shown in Fig. 5. In the encoding apparatus 200, 
shown in Fig. 11 , the parts or components correspond- 
ing to those shown in Fig. 5 are denoted by the same 
numerals and operate similarly so that such parts are 
not here further explained in detail. 

With the encoding apparatus 200, the frame mem- 
ory 201 is provided downstream of the frame memory 



102, so that an output of the frame memory 102 is ap- 
plied to the frame memory 201 and an output of the 
frame memory 201 is supplied to the subtraction circuit 
106a of the encoding processing circuit 106. The mem- 

5 ory 202 is provided downstream of the ME circuit 103 
which has an output supplied to the memory 202 while 
the output of memory 202 is supplied to the frame mem- 
ory 106g of the encoding processing circuit 106. In the 
encoding apparatus 200, the scene change detection 

10 circuit 101 is supplied with the motion vector outputted 
by the ME circuit 103 instead of with the input video sig- 
nals. 

It will be appreciated that the encoding apparatus 
200 is configured for detecting scene changes by ex- 
ts plotting motion vector detection operations performed 
by the ME circuit 103. Similarly to the encoding appara- 
tus 100, the encoding apparatus 200 converts the P-pic- 
ture into an l-picture for processing the P-picture as the 
l-picture so as to reduce the volume of the code gener- 
ic ation in case there is no correlation on the time axis de- 
spite motion compensation executed by the MC circuit 
106b with the result that the amount ol the generated 
code information cannot be reduced on calculating inter- 
picture differences. 
25 In the encoding apparatus 100 shown in Fig. 5, a 
scene change is detected by integrating the inter-picture 
differences for one picture period. Therefore, panning a 
picture may be erroneously delected as being a scene 
change. 

30 With the encoding apparatus 200, the foregoing 
problem is avoided by integrating residuals found at the 
time of motion vector detection in the ME circuit 103 so 
as to be capable of predicting the differential information 
amount after motion compensation by the MC circuit 

35 106, instead of simply finding the inter-picture differenc- 
es. 

In other words, the ME circuit 103 detects the mo- 
tion vector across the interval between I -pictures. 
Therefore, for exploiting the detected motion vector, the 
40 motion vector detected by the ME circuit 103 needs to 
be stored for one l-picture period. 

The memory 202 stores the motion vector produced 
by the ME circuit 103 for one l-picture period. The frame 
memory 201 has a storage capacity of one picture and 
45 stores one picture of the input video signals stored in 
the frame memory 102. Thus the input video signals are 
stored in the frame memory 201 for one picture period. 

The scene change detection circuit 101 finds the 
sum of absolute values of residuals obtained at the time 
so ol motion vector detection by the ME circuit 103. If a 
scene change has been detected, the information on the 
sum of the absolute values is routed to the timing control 
circuit 105. 

Meanwhile, by utilizing the residuals found at the 
ss time of motion vector detection as described above, a 
scene change may be detected at the time of bi-direc- 
tional predictive coding by the motion vector extending 
in one or the opposite direction. Thus, if a scene change 
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has actually occurred in a B-picture, it can hardly be de- 
lected as being a scene change in the B-picture. How- 
ever, since the P-picture is converted by the encoding 
apparatus 200 into the l-picture, the use of residuals 
may be said to be most appropriate for detecting scene s 
changes. Consequently, fixed length setting can be 
achieved more reliably in the bit rate control range, while 
scene changes can be coped with more flexibly. Since 
fixed length setting can be achieved more reliably writ- 
ing and re-writing may be achieved more reliably in a to 
pre-set range of the recording medium. In addition, it is 
sufficient that the frame memory 102 have a storage ca- 
pacity of at least three pictures, while it is sufficient that 
the- frame memory 201- have a storage capacity of at 
least one picture, so that the memory size can be re- ts 
duced more significantly than with the prior-art appara- 
tus, for further reducing the production cost of the appa- 
ratus. 

The present techniques may also be applied to a 
■recording apparatus 300, for example, as shown in Fig. - 20 
12. The recording apparatus 300 includes an encoding 
circuit 301 , which may correspond to the encoding ap- 
paratus 100 described above with reference to Fig. 5, 
and a recording processing circuit 302 for recording an 
output of the encoding circuit 301 on a recording medi- 2S 
um 303 which may be disc-shaped as shown. 

Since the encoding circuit 301 may be similar in 
structure to the encoding apparatus 100 shown in Fig. 
5, it will not be again explained in detail. 

The encoding circuit 301 performs bit control as 30 
shown in Fig. 13 and transmits the resulting bitstream 
to the recording processing circuit 302- 

The recording processing circuit 302 records the 
bitstream from the encoding circuit 301 in a pre-set 
range on the disc-shaped recording medium 303. The 35 
data is recorded on the disc-shaped medium 303 in 
terms of fixed unit lengths or re-writing units W, as 
shown in Fig. 14. During such recording on the recording 
medium 303, the recording processing circuit 302 de- 
tects the range of the executed fixed length setting of *o 
the bitstream from the encoding circuit 301 . 

As shown in Fig. 15, the bitstream outputted by the 
encoding circuit 301 is comprised of data of, for exam- 
ple, the MPEG2 system, and includes plural blocks each 
having a sequence header SH, a sequence expanding 45 
portion SE, a GOP header GOPH, a picture header PH, 
a picture encoding function expanding portion PCE, an 
expanding and user data portion EUD and a picture data 
portion PD. 

The expanding and the user data portion EUD is so 
comprised of an expanded data portion ED and a user 
data portion UD. The user data portion UD is made up 
of a 32-bit user data start code UDSC and an 8-bit user 
data UD. 

The user data has inserted therein the information ss 
concerning the range of the fixed length, that is the 
above-mentioned fixed length setting point flag. Thus, 
by delecting the fixed length setting point flag from the 



supplied bitstream, the recording processing circuit 302 
can recognize the range of the executed fixed length 
setting and record the bitstream on the recording medi- 
um 303 in terms of the fixed unit length W. 

Fig. 16 shows the manner in which picture type 
management is performed in the recording processing 
circuit 302 in case at least one or more bit rate control 
units are combined to form the fixed unit length W of Fig. 
14. If there is no scene change, as in bitstream A 1 on 
Fig. 16, l-pictures and P-pictures are arranged at all 
times at equal intervals in a fixed length unit W. If there 
is a scene change, for example, as in the bitstream Ag, 
the l-picture l 13 , which is normally disposed at a rear 
-portion of the bit-rate-control range or unit, is instead 
disposed at a forward portion of such unit. Thus, in the 
encoding circuit 301 , a larger number of residual bits is 
used for a picture where a scene change has occurred. 
If there is no scene change in the range or unit next to 
the bit rate control range or unit where a scene change 
has occurred,- as in the bitstrean A 2 , the I -picture l 2 is 
disposed at the same position as in the bitstream A., 
where no scene change had been produced. 

Picture type management in the recording process- 
ing circuit 302 will now be explained for the case where 
the encoding circuit 301 performs bit rate control in the 
manner described above with reference to Fig. 9, that 
is, in the case where the normal position of the l-picture 
is disposed at a leading end of each bit rate control 
range or unit. 

In the bit rate control 107, shown in Fig. 5, the bit 
rate control range or unit is increased by a factor of two 
in the event of a scene change for shifting the number 
of residual bits of the rear side l-picture to a forward po- 
sition. In the recording apparatus 300, however, the 
fixed length setting is executed at a constant position. 
Thus, the bit rate control similar to that shown in Fig. 9 
is performed within the fixed length W. However, since 
the position of execution of the fixed length setting can- 
not be changed, in the bit rate control of the last picture 
within the range of the fixed length setting, that picture 
is changed to an l-picture, so that the residual bits can- 
not be brought to the forward position. 

More specifically, as shown in Fig. 17, if there is no 
scene change, as in a bitstream C v l-pictures and P- 
pictures are arranged at all times at equal intervals, with 
the l-pictures being normally positioned at the leading 
ends ol the respective bit rate control units in a fixed 
length unit W. If there is a scene change, as in a bit- 
stream C 2 , the l-picture in the next bit rate control unit 
is disposed at a forward position, as at l 3 . Thus, in the 
encoding circuit 301, an increased number of residual 
bits is used for a picture where a scene change has oc- 
curred. However, in any one bit rate control range, the 
number of residual bits in the next bit rate control range 
may be shifted only once to the preceding bit rate control 
range. 

Thus it becomes possible to reproduce a high-qual- 
ity picture free of picture quality deterioration from the 
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recording medium 302 on which data has been correctly 
recorded in the pre-set range. Since the encoding circuit 
301 used in the recording apparatus 300 has a reduced 
cost ot production. The cost o1 producing the apparatus 
300 is similarly reduced. 

If a scene change has occurred as previously ex- 
plained in connection with Figs. 1 6 and 1 7, the following 
picture type management may also be used. 

More specifically, if there are scene changes, as in 
bitstreams B2 or D 2 in Figs. 16 and 17, respectively, the 
l-pictures l 4 and l 5 , respectively, subsequent to a scene 
change may be restored gradually to the normal posi- 
tions instead of being restored abruptly to the normal 
positions as in the cases of the bitstreams A 2 and C 2 . 
Since the distance between the scene change position 
and the next l-picture position is not excessive, it be- 
comes possible to avoid deterioration in the picture qual- 
ity. 

The encoding circuit 301 of the encoding apparatus 
300 has been described as corresponding to the encod- 
ing apparatus 1 00 shown in Fig. 5, but it is apparent that 
the encoding circuit 301 may alternatively be arranged 
to correspond substantially to the encoding circuit 200 
shown -rn* Fig: 11t ' 

Although specific embodiments of the invention and 
modifications thereof have been described in detail 
herein with reference to the accompanying drawings, it 
is to be understood that the invention is not limited there- 
to, and that various changes and further modifications 
may be effected therein by one skilled in the art without 
departing from the scope of the invention as defined in 
the appended claims. 



Claims 

1. An encoding apparatus for encoding input video 
signal data made up of a plurality of pictures re- 
ceived in sequence in accordance with an encoding 
system exploiting inter-frame prediction and which 
include at least l-pictures each encoded within a re- 
spective frame, comprising: 

storage means for storing said sequentially re- 
ceived pictures ot input video signal signal da- 
ta; 

change point detection means for detection of 
change points of said pictures of the input video 
signal data; 

encoding means for encoding the pictures 
stored in said storage means with a fixed en- 
coding length as an encoding unit so as to gen- 
erate a bitstream; 

timing control means responsive to said 
change point detection means for determining 
successive groups of said pictures with each of 
said groups including at least one of said l-pic- 
tures, and for controlling the processing timing 



ol the fixed length encoding of each picture in 
said group of pictures by said encoding means; 
and 

rate control means under control of said timing 
5 control means for controlling the range of a gen- 

eration rate control in said encoding means in 
accordance with said detection by said change 
point detection means so that said range of the 
code generation rate control begins at a picture 
io next to one of said l-pictures and terminates at 

the next l-picture, and so that, upon detection 
of a scene change by said change point detec- 
tion means, any residual data previously allo- 
cated to said one l-picture is allocated instead 
15 to another of said pictures. 

2. The encoding apparatus as in claim 1 ; wherein said 
rate control means fixes a starting picture and a 
number of said pictures contained in said range of 

20 the code generation rate control. 

3. The encoding apparatus as in claim 1 ; wherein said 
rate control means doubles said range of the code 

-generation rate control- in case of said detection of 
25 a scene change. 

4. The encoding apparatus as in claim 1 ; wherein said 
rate control means inserts information specifying 
said range of the code generation rate control in 

so said bitstream. 

5. The encoding apparatus as in claim 1 ; wherein said 
rate control means overrides said detection by said 
change point detection means until said other pic- 

35 ture is encoded with fixed length encoding by said 
encoding means. 

6. The encoding apparatus as in claim 1 ; further com- 
prising means for effecting motion vector detection 

40 in connection with inter-frame prediction; and 
wherein said change point detection means detects 
a change point of said pictures of the input video 
signal data based on the amount of said residual 
data at the time of said motion vector detection in 

45 inter-frame prediction. 

7. A video signal recording apparatus comprising: 

an encoding device for encoding input video 
so signal data made up of a plurality of pictures 

received in sequence in accordance with an en- 
coding system exploiting inter-frame prediction 
and which include at least l-pictures each en- 
coded within a respective frame, said encoding 
55 device including storage means for storing said 

sequentially received pictures of input video 
signal data, change point detection means for 
the detection of change points of said pictures 
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of 1he input video signal data, encoding means 
tor encoding the pictures stored in said storage 
means with a fixed encoding length as an en- 
coding unit soas to generate a bitstream, timing 
control means responsive to said change point $ 
detection means for determining successive 
groups of said pictures with each of said groups 
including at least one of said l-pictures, and for 
controlling the processing timing of the fixed 
length encoding of each picture in each said to 
group of pictures by said encoding means, and 
rate control means under control of said timing 
control means for controlling a range of a gen- 
eration rate control in said encoding means in 
accordance with said detection by said change is 
point detection means so that said range of the 
code generation rate control begins at the pic- 
ture next to one of said l-pictures and termi- 
nates at the next l-picture, and so that, upon 

" detection of a- scene change by-said- change so 

point detection means, any residual data previ- 
ously allocated to said one l-picture is allocated 
instead to another of said pictures; and 
recording means for recording said bitstream 
generated by said encoding means onto a re- 2S 
cording medium. 



8. The recording apparatus as in claim 7; wherein said 
rate control means fixes a starting picture and a 
number of said pictures contained in the range of 
said code generation rate control. 

9. The recording apparatus as in claim 7; wherein said 
rate control means doubles said range of the code 
generation rate control in case of said detection of 
a scene change. 

1 0. The recording apparatus as in claim 7; wherein said 
rate control means inserts information specifying 
said range of code generation rate control in said 
bitstream. 

11. The recording apparatus as in claim 7; wherein said 
rate control means overrides said detection by said 
change point detection means until said other pic- 
ture is encoded by fixed unit length encoding by said 
encoding means. 

12. The recording apparatus as in claim 7; wherein said 
encoding device further includes means for effect- 
ing motion vector detection in connection with inter- 
frame prediction; and wherein said change point de- 
tection means detects a change point of said pic- 
tures of the input video signal data based on the 
amount of said residual data at the time of said mo- 
tion vector detection in inter-frame prediction. 

13. A method for encoding video signal data made up 



of a plurality of pictures received in sequence in ac- 
cordance with an encoding system exploiting inter- 
frame prediction and which include at least l-pic- 
tures each encoded within a respective frame, com- 
prising the steps of: 

temporarily storing said sequentially received 
pictures of input video signal data; 
detecting change points of said pictures of the 
input video signal data; 

encoding the stored pictures with a fixed encod- 
ing length as an encoding unit so as to generate 
a bitstream; 

in response to said change point detection, de- 
termining successive groups of said pictures 
with each of said groups including at least one 
or said l-pictures, and controlling the process- 
ing timing of the fixed length encoding of each 
picture in said group of pictures; and 
- controlling the range of a code generation rate 
in sard encoding in accordance with said detec- 
tion of change points so that said range of the 
code generation rate begins at a picture next to 
one of said l-pictures and terminates at the next 
l-picture, and sothat : upon detection of a scene 
change by said change point detection, any re- 
sidual data previously allocated to said one I- 
picture is allocated instead to another of said 
pictures. 

30 

14. The encoding method as in ciaim 13; wherein a 
starting picture and a number of said pictures con- 
tained in said range of the code generation rate are 
fixed. 

35 

15. The encoding method as in claim 13; wherein said 
range of the code generation rate is doubled in case 
of said detection of a scene change. 

40 16. The encoding method as in claim 13; further com- 
prising the step of inserting in said bitstream infor- 
mation specifying said range of the code generation 
rate. 



*s 17. The encoding method as in claim 13; further com- 
prising overriding said detection of a scene change 
until said other picture to which said residual data 
is allocated has been encoded with fixed length en- 
coding. 

so 

18. The encoding method as in claim 13; further com- 
prising effecting motion vector detection in connec- 
tion with inter-frame prediction; and wherein said 
detecting of change points of said pictures of the 
ss input video signal data is based on the amount of 
said residual data at the time of said motion vector 
detection in inter-frame prediction. 
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(54) Video data encoding and recording 



(57) In an encoding apparatus having a memory of 
diminished size for lowering the production cost, the 
memory stores input video signals made up of plural pic- 
tures including intra-pictures (l-pictures) and a scene 
change detector 101 detects change points of the input 
video signals. An encoding unit 106 encodes pictures 
stored in the memory 102 by fixed length encoding for 
generating a bitstream. A timing control unit 105 deter- 
mines successive groups of pictures, each including at 
least an intra-picture, on the basis of the detection by 



the scene change detector 101, and controls the 
processing timing of fixed length encoding of each pic- 
ture in the group of pictures by the encoding unit 1 06. A 
rate control unit 107 sets a range from a picture next to 
an intra-picture to the next intra-picture as a range of 
the code generation rate in the encoding unit 106. The 
rate control unit 107 controls the range of the code gen- 
eration rate so that, if a scene change has been detect- 
ed, the amount of the encoding information previously 
allocated to the intra-picture will be allocated to other 
pictures. 
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